Information processing apparatus, information processing system, and information processing method

ABSTRACT

The disclosure provides an information processing apparatus, an information processing system, and an information processing method capable of allowing a user to approach a destination intuitively. An information processing apparatus according to the present technology includes a position-coordinate acquisition part, a direction acquisition part, a direction calculation part, and a haptic-feedback determining part. The position-coordinate acquisition part acquires a position coordinate of the information processing apparatus. The direction acquisition part acquires an apparatus direction that the information processing apparatus faces. The direction calculation part calculates a target direction being a direction of a target with respect to the information processing apparatus from a position coordinate of the target and the position coordinate of the information processing apparatus. The haptic-feedback determining part determines a haptic feedback to be presented to a user on the basis of an angle formed by the apparatus direction and the target direction.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 16/324,469, filed on Feb. 8, 2019, which claims the benefit ofInternational Application No. PCT/JP2017/022476, filed Jun. 19, 2017,which claims priority to Japanese Application No. 2016-160681, filedAug. 18, 2016, the disclosures of which are incorporated herein byreference.

BACKGROUND

The present technology relates to a technology of an informationprocessing apparatus, an information processing system, and aninformation processing method capable of being used for guiding a userto a target position in real space.

With diffusion of a portable information terminal such as a smartphone,a method of setting a particular spot as a destination on a mapdisplayed on an information terminal beforehand, and approaching thedestination by checking position information and the destinationacquired by the information terminal with the ones in real time becomesgeneral.

SUMMARY Technical Problem

However, in the method described above, it is necessary for a user tounderstand how to see the map sufficiently, and set the destination onthe map accurately. Moreover, it is possible that the user mistakes adirection in real space for the direction on the map while approachingthe destination. Furthermore, the position information that isacquirable by the GPS (Global Positioning System) or the like may ofteninclude an error, and it is also difficult for the user to grasp theposition information around the destination on the map in detail.

In view of the above-mentioned circumstances, it is an object of thepresent technology to provide an information processing apparatus, aninformation processing system, and an information processing methodcapable of allowing a user to approach a destination intuitively.

Solution to Problem

In order to attain the above-mentioned object, an information processingapparatus according to an embodiment of the present technology includesa position-coordinate acquisition part, a direction acquisition part, adirection calculation part, and a haptic-feedback determining part.

The position-coordinate acquisition part acquires a position coordinateof the information processing apparatus.

The direction acquisition part acquires an apparatus direction that theinformation processing apparatus faces.

The direction calculation part calculates a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus.

The haptic-feedback determining part determines a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

According to the structure, the haptic feedback determined on the basisof the angle formed by the apparatus direction and the target directionis presented to the user. As a result, when the user turns theinformation processing apparatus to various directions, the user maygrasp whether the apparatus direction coincides with the targetdirection or not by the haptic feedback without seeing a display, andmay detect the target direction intuitively.

The haptic-feedback determining part determines a first haptic feedbackas the haptic feedback to be presented to the user in a case that theformed angle is a predetermined value or more, and determines a secondhaptic feedback being different from the first haptic feedback as thehaptic feedback to be presented to the user in a case that the formedangle is less than the predetermined value.

According to the structure, in the case that the apparatus directiondoes not coincide with the target direction, and the angle formed by theapparatus direction and the target direction is the predetermined valueor more, the first haptic feedback is presented the user. On the otherhand, in the case that the apparatus direction coincides with the targetdirection, and the formed angle is less than the predetermined value,the second haptic feedback is presented to the user.

The haptic-feedback determining part determines an intensity of thefirst haptic feedback according to a size of the formed angle in thecase that the formed angle is the predetermined value or more.

According to the structure, the user may detect the target direction byusing the intensity of the first haptic feedback, and as a result, theuser may easily find the target direction.

The haptic-feedback determining part may determine an intensity of thesecond haptic feedback according to a distance between the informationprocessing apparatus and the target in the case that the formed angle isless than the predetermined value.

According to the structure, the user may estimate the distance betweenthe information processing apparatus and the target position by usingthe intensity of the second haptic feedback.

The information processing apparatus may further include ahaptic-feedback presenting part presenting the haptic feedback to theuser, and the haptic-feedback presenting part may produce an oscillationthat causes the user to feel that the information processing apparatusis pulled in a predetermined direction.

According to the structure, the user may easily find the target positionby using a feeling (haptic feedback) that the information processingapparatus is pulled in the predetermined direction. For example, thehaptic-feedback presenting part may not present the haptic feedback inthe case that the angle formed by the apparatus direction and the targetdirection is the predetermined value or more, and the haptic-feedbackpresenting part may present the haptic feedback that the informationprocessing apparatus moves in the target direction in the case that theformed angle is less than the predetermined value.

The information processing apparatus may further include atarget-position setting part setting the position coordinate of theinformation processing apparatus as the position coordinate of thetarget according to a predetermined operation input to the informationprocessing apparatus.

According to the structure, the position coordinate of the informationprocessing apparatus may be set as the position coordinate of thetarget. For example, after the present position of the informationprocessing apparatus is set as the position of the target, the user maymove from the present position, and may search for the target positionagain.

In order to attain the above-mentioned object, an information processingsystem according to an embodiment of the present technology includes aposition-coordinate acquisition part, a direction acquisition part, adirection calculation part, and a haptic-feedback determining part.

The position-coordinate acquisition part acquires a position coordinateof an information processing apparatus.

The direction acquisition part acquires an apparatus direction that theinformation processing apparatus faces.

The direction calculation part calculates a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus.

The haptic-feedback determining part determines a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

In order to attain the above-mentioned object, in an informationprocessing method according to an embodiment of the present technology,a position-coordinate acquisition part acquires a position coordinate ofan information processing apparatus.

A direction acquisition part acquires an apparatus direction that theinformation processing apparatus faces.

A direction calculation part calculates a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus.

A haptic-feedback determining part determines a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

Advantageous Effects of Invention

As described above, according to the present technology, an informationprocessing apparatus, an information processing system, and aninformation processing method capable of allowing a user to approach adestination intuitively may be provided. Note that the effects describedabove are not limitative, but any effect described in the presentdisclosure may be produced.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 A perspective view showing an information processing apparatusaccording to a first embodiment of the present technology.

FIG. 2 A block diagram showing a functional configuration of theinformation processing apparatus.

FIG. 3 A diagram schematically showing the functional configuration ofthe information processing apparatus.

FIG. 4 A diagram schematically showing an operation mode of theinformation processing apparatus.

FIG. 5 A diagram schematically showing an operation mode of theinformation processing apparatus.

FIG. 6 A flowchart showing an operation of the information processingapparatus.

FIG. 7 A diagram schematically showing an operation mode of theinformation processing apparatus.

FIG. 8 A block diagram showing a hardware configuration of theinformation processing apparatus.

FIG. 9 A perspective view showing an information processing apparatusaccording to a second embodiment of the present technology.

FIG. 10 A block diagram showing a functional configuration of theinformation processing apparatus.

FIG. 11 A diagram schematically showing an operation mode of theinformation processing apparatus.

FIG. 12 An example of a camera-through image imaged by the informationprocessing apparatus.

FIG. 13 An example of a camera-through image on which an object issuperimposed by the information processing apparatus.

FIG. 14 A flowchart showing an operation of the information processingapparatus.

DETAILED DESCRIPTION

[Structure of Information Processing Apparatus]

FIG. 1 is a perspective view showing an information processing apparatus100 according to the present embodiment. The information processingapparatus 100 may be a portable information processing apparatus such asa smartphone, a tablet PC, or a head mount display, in other words, aninformation processing apparatus capable of realizing a functionalconfiguration described below. Hereinafter, the information processingapparatus 100 will be assumed to be a smartphone and be described.

As shown in FIG. 1 , the information processing apparatus 100 includes adisplay 101. Furthermore, the information processing apparatus 100 mayinclude a button and the like that are not shown.

FIG. 2 is a block diagram showing the functional configuration of theinformation processing apparatus 100. As shown in FIG. 2 , theinformation processing apparatus 100 includes a target-position settingpart 111, a position-coordinate acquisition part 112, a directionacquisition part 113, a direction calculation part 114, ahaptic-feedback determining part 115, and a haptic-feedback presentingpart 116 as the functional configuration.

FIG. 3 is a diagram schematically illustrating the functionalconfiguration of the information processing apparatus 100. In FIG. 3 , atarget P (position p_(g): (x_(g), y_(g), z_(g))) is shown.

The target-position setting part 111 sets a position coordinate of thetarget P. The target P is a target appointed by a user in real space.Typically, when the user appoints an arbitrary position in a mapapplication displayed on the display 101, a position coordinate in realspace corresponding to the position appointed on the map is acquired bythe map application.

The target-position setting part 111 acquires the position coordinate bysuch a map application, and sets the position coordinate as the positioncoordinate of the target P. Furthermore, the target-position settingpart 111 may set the position coordinate of the target P by using anarbitrary method. The position coordinate of the target P may be atwo-dimensional coordinate (for example, longitude and latitude), andmay also be a three-dimensional coordinate (for example, longitude,latitude, and height). The target-position setting part 111 supplies theposition coordinate of the set target P to the direction calculationpart 114.

The position-coordinate acquisition part 112 acquires a positioncoordinate (position p: (x, y, z)) of the information processingapparatus 100. Specifically, the position-coordinate acquisition part112 may acquire the position coordinate of the information processingapparatus 100 by using the GPS (Global Positioning System). Moreover,the position-coordinate acquisition part 112 may also acquire theposition coordinate of the information processing apparatus 100 by usingWi-Fi or the like. The position-coordinate acquisition part 112 suppliesthe acquired position coordinate of the information processing apparatus100 to the direction calculation part 114.

The direction acquisition part 113 acquires a direction (hereinafter,apparatus direction) that the information processing apparatus 100faces. Typically, the direction that the information processingapparatus 100 faces is a direction along an extended line of the display101 in its longitudinal direction. However, this is not particularlylimited, and may be a particular direction in which the informationprocessing apparatus 100 is a center. The direction acquisition part 113may acquire the apparatus direction by using an output from each of ageomagnetic sensor or an acceleration sensor. In FIG. 3 , an apparatusdirection A1 is shown as the direction that the information processingapparatus 100 faces. The direction acquisition part 113 supplies theapparatus direction A1 to the haptic-feedback determining part 115.

The direction calculation part 114 calculates a target direction. Thetarget direction is a direction of the target P with respect to theinformation processing apparatus 100. The direction calculation part 114may calculate the target direction from the position coordinate of thetarget P supplied from the target-position setting part 111 and theposition coordinate of the information processing apparatus 100 suppliedfrom the position-coordinate acquisition part 112. In FIG. 3 , a targetdirection A2 is shown. The direction calculation part 114 supplies thetarget direction A2 to the haptic-feedback determining part 115.

The haptic-feedback determining part 115 determines a haptic feedbackthat the haptic-feedback presenting part 116 presents to the user.Specifically, the haptic-feedback determining part 115 determines thehaptic feedback to be presented to the user on the basis of an angleformed by the apparatus direction A1 and the target direction A2.

FIGS. 4 and 5 are diagrams schematically showing the angle θ (θ (t): |θ(t)|≤π) formed by the apparatus direction A1 and the target directionA2. As shown in FIG. 4 , the haptic-feedback determining part 115determines a first haptic feedback as the haptic feedback to bepresented to the user in a case that the apparatus direction A1 and thetarget direction A2 do not coincide with each other, and the angle θ isa predetermined value or more.

Moreover, as shown in FIG. 5 , the haptic-feedback determining part 115determines a second haptic feedback as the haptic feedback to bepresented to the user in a case that the apparatus direction A1 and thetarget direction A2 coincide with each other, and the angle θ is lessthan the predetermined value. The predetermined value is notparticularly limited, and for example, 5 degrees. The haptic-feedbackdetermining part 115 supplies the determined haptic feedback to thehaptic-feedback presenting part 116.

The haptic-feedback presenting part 116 presents the haptic feedbackdetermined by the haptic-feedback determining part 115 to the user. Thehaptic-feedback presenting part 116 produces a particular oscillation tothe information processing apparatus 100, and may be a haptic-feedbackpresenting device (See WO/2015/151380) capable of causing the userholding the information processing apparatus 100 to feel (hapticfeedback) that the information processing apparatus 100 is pulled in aparticular direction.

For example, the haptic-feedback presenting part 116 may produce anoscillation being continuous and little by little as the first hapticfeedback, and may produce an oscillation having a larger amplitude thanan amplitude of the first haptic feedback as the second haptic feedback.Moreover, as shown by an arrow Y1 in FIG. 5 , the haptic-feedbackpresenting part 116 may produce a haptic feedback that the informationprocessing apparatus 100 is pulled in the apparatus direction A1 as thesecond haptic feedback.

Examples of the first haptic feedback include oscillations expressed by[Math. 1] and [Math. 2] described below.

$\begin{matrix}{{Intensity} = \frac{\pi - {{\theta(t)}}}{\pi}} & \left\lbrack {{Math}.\mspace{14mu} 1} \right\rbrack \\{{Intensity} = \left\{ \begin{matrix}1 & {{{if}\mspace{14mu}{{\theta(t)}}} < {{\theta\left( {t - 1} \right)}}} \\0 & {otherwise}\end{matrix} \right.} & \left\lbrack {{Math}.\mspace{14mu} 2} \right\rbrack\end{matrix}$

Examples of the second haptic feedback include oscillations expressed by[Math. 3] and [Math. 4] described below.

$\begin{matrix}{\mspace{20mu}{{Intensity} = \left\{ \begin{matrix}1 & {{{if}\mspace{14mu} ɛ} \leqq {{{\theta\left( {t - 1} \right)}}\mspace{14mu}{AND}\mspace{14mu}{{\theta(t)}}} < ɛ} \\0 & {otherwise}\end{matrix} \right.}} & \left\lbrack {{Math}.\mspace{14mu} 3} \right\rbrack \\{{Intensity} = \left\{ \begin{matrix}1 & {{{{if}\mspace{14mu}{{\theta(t)}}} < {ɛ\mspace{14mu}{AND}\mspace{14mu} d} < {T\; 1_{d}}}\mspace{70mu}} \\\frac{{T\; 2_{d}} - d}{T\; 2_{d}} & {{{if}\mspace{14mu}{{\theta(t)}}} < {ɛ\mspace{14mu}{AND}\mspace{14mu} T\; 1_{d}} < d < {T\; 2_{d}}} \\0 & {otherwise}\end{matrix} \right.} & \left\lbrack {{Math}.\mspace{14mu} 4} \right\rbrack\end{matrix}$

Furthermore, the haptic-feedback presenting part 116 may produce anyhaptic feedback as long as the user may recognize a difference betweenthe first haptic feedback and the second haptic feedback. Moreover, ahaptic-feedback presenting mechanism is not limited to thehaptic-feedback presenting device, and may be an eccentric motor. Inthis case, the haptic-feedback presenting part 116 may present the firsthaptic feedback and the second haptic feedback to the user by changingat least one of an oscillation duration, a frequency, or an amplitude ofthe eccentric motor.

[Operation of Information Processing Apparatus]

An operation of the information processing apparatus 100 will bedescribed. FIG. 6 is a flowchart showing the operation of theinformation processing apparatus 100. Note that the position coordinateof the target P is preset by the target-position setting part 111.

First, the position-coordinate acquisition part 112 acquires theposition coordinate of the information processing apparatus 100 (St101),and the haptic-feedback determining part 115 compares the positioncoordinate of the information processing apparatus 100 with the positioncoordinate of the target P (St102).

In a case that the position coordinate of the information processingapparatus 100 and the position coordinate of the target P coincide witheach other (St103: Yes), the information processing apparatus 100 endsthe operation. In a case that the position coordinate of the informationprocessing apparatus 100 and the position coordinate of the target P donot coincide with each other (St103: No), the direction acquisition part113 acquires the apparatus direction A1 (St104).

Next, the direction calculation part 114 calculates the target directionA2 (St105), and the haptic-feedback determining part 115 compares theapparatus direction A1 with the target direction A2 (St106).

In the case that the apparatus direction A1 and the target direction A2do not coincide with each other (St107: No), the haptic-feedbackdetermining part 115 determines the first haptic feedback as the hapticfeedback to be presented to the user, and the haptic-feedback presentingpart 116 presents the first haptic feedback to the user (St108). In thecase that the apparatus direction A1 and the target direction A2coincide with each other (St107: Yes), the haptic-feedback determiningpart 115 determines the second haptic feedback as the haptic feedback tobe presented to the user, and the haptic-feedback presenting part 116presents the second haptic feedback to the user (St109).

The information processing apparatus 100 executes the operation untilthe position coordinate of the information processing apparatus 100 andthe position coordinate of the target P coincide with each other (St103:Yes).

Seen by the user, when the user turns the information processingapparatus 100 to a predetermined direction after appointing the targetP, the first haptic feedback is presented from the informationprocessing apparatus 100 in the case that the apparatus direction A1 andthe target direction A2 do not coincide with each other. Then, the usermay recognize that the apparatus direction A1 and the target directionA2 do not coincide with each other.

When the user changes the direction that the information processingapparatus 100 faces, and the apparatus direction A1 and the targetdirection A2 coincide with each other, the second haptic feedback ispresented from the information processing apparatus 100. Then, the usermay recognize that the apparatus direction A1 and the target directionA2 coincide with each other.

Due to this, the user may grasp the direction in which the target existsintuitively without seeing the display 101 on the information processingapparatus 100.

[Change of Intensity of First Haptic Feedback]

As described above, in the case that the apparatus direction A1 and thetarget direction A2 do not coincide with each other, the haptic-feedbackdetermining part 115 presents the first haptic feedback to the user.However, as the angle θ formed by the apparatus direction A1 and thetarget direction A2 is smaller, an intensity of the first hapticfeedback may be increased. The haptic-feedback presenting part 116 mayincrease the intensity of the first haptic feedback by changing afrequency or the amplitude of the oscillation producing the first hapticfeedback.

Due to this, the user may grasp that the apparatus direction A1approaches the target direction A2 by the intensity of the first hapticfeedback, and as a result, the user may easily make the apparatusdirection A1 coincide with the target direction A2.

[Guidance to Target Direction by First Haptic Feedback]

FIG. 7 is a diagram schematically showing a method of guidance to thetarget direction A2 by the first haptic feedback. As shown by an arrowY2 in FIG. 7 , the haptic-feedback presenting part 116 may present ahaptic feedback that the information processing apparatus 100 is pulledin the target direction A2 as the first haptic feedback to the user inthe case that the apparatus direction A1 and the target direction A2 donot coincide with each other.

Due to this, the user may grasp the target direction A2 through thefirst haptic feedback, and as a result, the user may easily make theapparatus direction A1 coincide with the target direction A2.

[Change of Intensity of Haptic Feedback by Distance]

The haptic-feedback determining part 115 may change the intensity of thefirst haptic feedback and an intensity of the second haptic feedbackaccording to the distance between the information processing apparatus100 and the target P. The haptic-feedback determining part 115 maycalculate a distance d (See FIG. 3 ) between the information processingapparatus 100 and the target P from the position coordinate of theinformation processing apparatus 100 and the position coordinate of thetarget P.

Specifically, the haptic-feedback presenting part 116 may increase theintensity of the first haptic feedback as the distance d is smaller, inthe case that the apparatus direction A1 and the target direction A2 donot coincide with each other. On the other hand, the haptic-feedbackpresenting part 116 may increase the intensity of the second hapticfeedback as the distance d is smaller, in the case that the apparatusdirection A1 and the target direction A2 coincide with each other.Moreover, the haptic-feedback presenting part 116 may increase only oneof the intensity of the first haptic feedback or the intensity of thesecond haptic feedback as the distance d is smaller.

Due to this, besides the direction of the target P, the user may alsograsp the distance between the information processing apparatus 100 andthe target P.

[Method of Appointing Position]

As described above, the target-position setting part 111 sets theposition appointed by the user as the position of the target P. However,appointment of the position by the user is not limited to appointment byusing the map application. For example, when the user taps the display101 on which a touch sensor is provided, the target-position settingpart 111 may acquire the position coordinate of the informationprocessing apparatus 100 from the position-coordinate acquisition part112, and may set the acquired position coordinate as the positioncoordinate of the target P.

Furthermore, the target-position setting part 111 may set the positioncoordinate of the information processing apparatus 100 as the positioncoordinate of the target P according to a particular operation input bythe user such as pressing a particular button provided on theinformation processing apparatus 100 or shaking the informationprocessing apparatus 100. Due to this, the user may more easily set theposition coordinate of the target P than by using the map application.

At this time, position information of the information processingapparatus 100, user information related to the information processingapparatus 100 itself, the point of time, weather information or the likemay be saved in the information processing apparatus 100, a server, orthe like.

[Hardware Configuration]

FIG. 8 is a diagram schematically showing a hardware configuration ofthe information processing apparatus 100. As shown in FIG. 8 , theinformation processing apparatus 100 includes a CPU 151, a GPU 152, amemory 153, a storage 154, and an input/output part (I/O) 155 as thehardware configuration. These are connected to each other by a bus 156.

The CPU (Central Processing Unit) 151 controls the other configurationaccording to a program stored in the memory 153, performs dataprocessing according to the program, and stores a processing result inthe memory 153. The CPU 151 may be a microprocessor.

The GPU (Graphic Processing Unit) 152 is controlled by the CPU 151, andexecutes image processing. The CPU 151 is capable of causing the GPU 152to execute parallel arithmetic processing and perform a characteristicamount of extraction at high speed. The GPU 152 may be a microprocessor.

The memory 153 stores a program and data executed by the CPU 151. Thememory 153 may be an RAM (Random Access Memory).

The storage 154 stores a program and data. The storage 154 may be an HDD(hard disk drive) or an SSD (solid state drive).

The input/output part 155 receives an input to the informationprocessing apparatus 100, and supplies an output from the informationprocessing apparatus 100 externally. The input/output part 155 includesan input apparatus such as a keyboard or a mouse, an output apparatussuch as a display, and a connection interface such as a network.

Moreover, hardware such as a GPS module, a geomagnetic sensor, and anacceleration sensor that realizes the functional configuration of theinformation processing apparatus 100 described above and is not shown isconnected to the input/output part 155.

The hardware configuration of the information processing apparatus 100is not limited to the configuration described above, and may be aconfiguration in which a functional configuration of an informationprocessing apparatus 1100 may be realized. Moreover, a part or all ofthe hardware configuration may exist in the network.

[Information Processing System]

The functional configuration of the information processing apparatus 100described above may be realized by an information processing systemincluding a plurality of information processing apparatuses that areconnected to each other. For example, the functional configuration ofthe information processing apparatus 100 described above may be realizedby the information processing system including an information processingapparatus that includes the position-coordinate acquisition part 112,the direction acquisition part 113, and the direction calculation part114, and an information processing apparatus that includes thehaptic-feedback presenting part 116.

Second Embodiment

FIG. 9 is a perspective view showing an information processing apparatus200 according to the present embodiment. The information processingapparatus 200 may be a portable information processing apparatus such asa smartphone, a tablet PC, or a head mount display, in other words, aninformation processing apparatus capable of realizing a functionalconfiguration described below. Hereinafter, the information processingapparatus 200 will be assumed to be a smartphone and be described.

As shown in FIG. 9 , the information processing apparatus 200 includes adisplay 201 and a camera 202. The camera 202 is provided on an oppositeside to the display 201. Furthermore, the information processingapparatus 200 may include a button and the like that are not shown.

FIG. 10 is a block diagram showing the functional configuration of theinformation processing apparatus 200. As shown in FIG. 10 , theinformation processing apparatus 200 includes a target-position settingpart 211, a position-coordinate acquisition part 212, a directionacquisition part 213, a direction calculation part 214, an imaging part215, an AR (Augmented Reality) processing part 216, a display part 217,a display processing part 218, and a UI-processing part 219 as thefunctional configuration.

FIG. 11 is a diagram schematically illustrating the functionalconfiguration of the information processing apparatus 200. In FIG. 11 ,a target P and a user U are shown.

The target-position setting part 211 sets a position coordinate of thetarget P. The target P is a target appointed by the user in real space.Typically, when the user appoints an arbitrary position in a mapapplication displayed on the display 201, a position coordinate in realspace corresponding to the position appointed on the map is acquired bythe map application.

The position coordinate of the target P may be a two-dimensionalcoordinate (for example, longitude and latitude), and may also be athree-dimensional coordinate (for example, longitude, latitude, andheight).

The position-coordinate acquisition part 212 acquires a positioncoordinate of the information processing apparatus 200. Specifically,the position-coordinate acquisition part 212 may acquire the positioncoordinate of the information processing apparatus 200 by using the GPS(Global Positioning System). Moreover, the position-coordinateacquisition part 212 may also acquire the position coordinate of theinformation processing apparatus 200 by using Wi-Fi or the like. Theposition-coordinate acquisition part 212 supplies the acquired positioncoordinate of the information processing apparatus 200 to the directioncalculation part 214.

The direction acquisition part 213 acquires a direction (hereinafter,apparatus direction) that the information processing apparatus 200faces. Typically, the direction that the information processingapparatus 200 faces is a direction orthogonal to the display 201, and isa direction of a visual field of the camera 202. However, this is notparticularly limited, and may be a particular direction in which theinformation processing apparatus 200 is a center. The directionacquisition part 213 may acquire the apparatus direction by using anoutput from each of a geomagnetic sensor or an acceleration sensor. InFIG. 11 , an apparatus direction A1 is shown as the direction that theinformation processing apparatus 200 faces. The direction acquisitionpart 113 supplies the apparatus direction A1 to the AR-processing part216.

The direction calculation part 214 calculates a target direction. Thetarget direction is a direction of the target P with respect to theinformation processing apparatus 200. The direction calculation part 214may calculate the target direction A2 from the position coordinate ofthe information processing apparatus 200 supplied from theposition-coordinate acquisition part 212 and the position coordinate ofthe target P supplied from the target-position setting part 211. In FIG.11 , the target direction A2 is shown. The direction calculation part214 supplies the target direction A2 to the AR-processing part 216.

The imaging part 215 generates a camera-through image from an outputfrom the camera 202, and supplies the camera-through image to theAR-processing part 216. FIG. 12 is an example of the camera-throughimage. Moreover, the imaging part 215 supplies an angle of view (zoomratio) of the camera 202 to the AR-processing part 216.

The AR-processing part 216 superimposes an object on the camera-throughimage. Specifically, the AR-processing part 216 calculates whichposition the target P corresponds to in the camera-through image fromthe apparatus direction A1, the target direction A2, and the zoom ratio.In FIG. 11 , the target position T in the camera-through image is shown.The AR-processing part 216 superimposes the object S on the targetposition T.

FIG. 13 is an example of the camera-through image on which the object Sis superimposed. As shown in FIG. 13 , the AR-processing part 216superimposes the object S on the camera-through image in which a realscene is imaged. A shape of the object S is not particularly limited,and may be a flag shape, for example.

The display part 217 controls the display 201 to display the image onthe basis of image information supplied from the display processing part218. The display processing part 218 performs processing in thecamera-through image on which the object S is superimposed by theAR-processing part 216 for displaying the camera-through image. TheUI-processing part 219 performs processing according to a UI (UserInterface) in the camera-through image on which the object S issuperimposed or the like.

[Operation of Information Processing Apparatus]

An operation of the information processing apparatus 200 will bedescribed. FIG. 14 is a flowchart showing the operation of theinformation processing apparatus 200. Note that the position coordinateof the target P is preset by the target-position setting part 211.

First, the position-coordinate acquisition part 212 acquires theposition coordinate of the information processing apparatus 200 (St201),and the AR-processing part 216 compares the position coordinate of theinformation processing apparatus 200 with the position coordinate of thetarget P (St202).

In a case that the position coordinate of the information processingapparatus 200 and the position coordinate of the target P coincide witheach other (St203: Yes), the information processing apparatus 200 endsthe operation. In a case that the position coordinate of the informationprocessing apparatus 200 and the position coordinate of the target P donot coincide with each other (St203: No), the direction acquisition part213 acquires the apparatus direction A1 (St204).

Next, the direction calculation part 214 calculates the target directionA2 (St205), and supplies the target direction A2 to the AR-processingpart 216. The imaging part 215 supplies the camera-through image and anangle of view thereof to the AR-processing part 216 (St206).

The AR-processing part 216 calculates the target position T that is theposition of the target P in the camera-through image from the apparatusdirection A1, the target direction A2, and the angle of view, andsuperimposes the object S on the target position T (St207).

The information processing apparatus 200 executes the operation untilthe position coordinate of the information processing apparatus 200 andthe position coordinate of the target P coincide with each other (St203:Yes).

Seen by the user, when the user turns the information processingapparatus 200 to a predetermined direction after appointing the targetP, the object S is superimposed on the target position T in thecamera-through image. The user may grasp the target P intuitively withreference to the object S in the camera-through image.

In a general AR (Augmented Reality) technology, an object issuperimposed by using a feature point that may be acquired from an imageimaged by a camera. On the other hand, in the present embodiment, theobject is superimposed on the basis of position information and theapparatus direction of the information processing apparatus 200. Thus,the object may also be superimposed on a far target position that thecamera may not capture.

[Display Mode of Object]

As described above, the AR-processing part 216 displays the object S onthe target position T in the camera-through image. However, a displaymode of the object S may be changed.

For example, the AR-processing part 216 may acquire weather informationnear the target P, and may change the object S according to the weatherinformation. Specifically, the AR-processing part 216 may change how theobject having the flag shape streams according to the weather near thetarget P (wind speed or the like).

Moreover, the AR-processing part 216 may change a size of the object Saccording to a distance between the information processing apparatus 200and the target P. Specifically, the AR-processing part 216 may make theobject S smaller as the distance between the information processingapparatus 200 and the target P is longer, and may make the object Slarger as the distance between the information processing apparatus 200and the target P is smaller.

In addition, the AR-processing part 216 may stop displaying the object Swhen the distance between the information processing apparatus 200 andthe target P is a predetermined value or less, or when the AR-processingpart 216 receives an operation input by the user. Furthermore, theAR-processing part 216 may stop displaying the object S when thedistance between the information processing apparatus 200 and the targetP is the predetermined value or more. This is effective in a case thatthe plurality of the targets P exist.

[Method of Using Object]

As described above, the target P may be appointed by the user of theinformation processing apparatus 200. Moreover, the target-positionsetting part 211 may also acquire a target position appointed by anotheruser via the Internet or the like and set the target position as thetarget P. Due to this, a plurality of users may share the same targetposition. At this time, a string or the like indicating a name of theuser appointing the target P may be displayed with the object.

The target P is not limited to a store or a facility, and an arbitrarytarget may be set as the target P. For example, in a case that anautomobile is set as the target P after parking the automobile, this isconvenient for searching for the parked automobile. Moreover, the targetP may be fixed on a particular position, and with movement of theinformation processing apparatus 200, the target-position setting part211 may also update the target P in real time.

Note that the target P is not limited to the target directly appointedby the user. For example, the target-position setting part 211 may set arecommended spot specified from an interest, a taste, or the like of theuser as the target P. Moreover, the target-position setting part 211 mayset a new target P on a route between the information processingapparatus 200 and the target P. At this time, the target-positionsetting part 211 may not set the new target P on a straight routebetween the information processing apparatus 200, but may set the newtarget P on a route that is selected by expecting route informationthereof such as the weather or congestion.

Furthermore, the target-position setting part 211 may appoint the targetP for calling for rescue, and a person who wants the other one to get inthe one's own automobile by car-allocation service may also appoint thetarget P. In addition, the target-position setting part 211 may appointa document or the like as the target P, and may present work or the likethat has to be done today by the object S.

Moreover, in the present embodiment, the object S is superimposed on thecamera-through image, and the target P is presented. However, the objectS may not necessarily be superimposed on the camera-through image, andthe AR-processing part 216 may make only the object S be displayed onthe display. Furthermore, the information processing apparatus 200 maypresent the target P by sound or a haptic feedback having directivityinstead of the object S.

[Hardware Configuration]

The information processing apparatus 200 may be realized by the similarhardware configuration to the hardware configuration of the informationprocessing apparatus 100 according to the first embodiment.

The hardware configuration of the information processing apparatus 200is not particularly limited, and may be a configuration in which thefunctional configuration described above may be realized. Moreover, apart or all of the hardware configuration may exist in the network.

[Information Processing System]

The functional configuration of the information processing apparatus 200described above may be realized by an information processing systemincluding a plurality of information processing apparatuses that areconnected to each other. For example, the functional configuration ofthe information processing apparatus 200 described above may be realizedby the information processing system including an information processingapparatus that includes the position-coordinate acquisition part 212,the direction acquisition part 213, and the direction calculation part214, an information processing apparatus that includes the imaging part215, the display part 217, and the display processing part 218, and aninformation processing apparatus that includes the AR-processing part216.

Note that the present technology may also employ the followingconfigurations.

(1)

An information processing apparatus, including:

a position-coordinate acquisition part acquiring a position coordinateof the information processing apparatus;

a direction acquisition part acquiring an apparatus direction that theinformation processing apparatus faces;

a direction calculation part calculating a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus; and

a haptic-feedback determining part determining a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

(2)

The information processing apparatus according to (1), in which

the haptic-feedback determining part determines a first haptic feedbackas the haptic feedback to be presented to the user in a case that theformed angle is a predetermined value or more, and determines a secondhaptic feedback being different from the first haptic feedback as thehaptic feedback to be presented to the user in a case that the formedangle is less than the predetermined value.

(3)

The information processing apparatus according to (2), in which

the haptic-feedback determining part determines an intensity of thefirst haptic feedback according to a size of the formed angle in thecase that the formed angle is the predetermined value or more.

(4)

The information processing apparatus according to (2) or (3), in which

the haptic-feedback determining part determines an intensity of thesecond haptic feedback according to a distance between the informationprocessing apparatus and the target in the case that the formed angle isless than the predetermined value.

(5)

The information processing apparatus according to any one of (1) to (4),further including

a haptic-feedback presenting part presenting the haptic feedback to theuser, in which

the haptic-feedback presenting part produces an oscillation that causesthe user to feel that the information processing apparatus is pulled ina predetermined direction.

(6)

The information processing apparatus according to any one of (1) to (5),further including

a target-position setting part setting the position coordinate of theinformation processing apparatus as the position coordinate of thetarget according to a predetermined operation input to the informationprocessing apparatus.

(7)

An information processing system, including:

a position-coordinate acquisition part acquiring a position coordinateof an information processing apparatus;

a direction acquisition part acquiring an apparatus direction that theinformation processing apparatus faces;

a direction calculation part calculating a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus; and

a haptic-feedback determining part determining a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

(8)

An information processing method, in which

a position-coordinate acquisition part acquires a position coordinate ofan information processing apparatus,

a direction acquisition part acquires an apparatus direction that theinformation processing apparatus faces,

a direction calculation part calculates a target direction being adirection of a target with respect to the information processingapparatus from a position coordinate of the target and the positioncoordinate of the information processing apparatus, and

a haptic-feedback determining part determines a haptic feedback to bepresented to a user on the basis of an angle formed by the apparatusdirection and the target direction.

It should be understood that various changes and modifications to thepresently preferred embodiments described herein will be apparent tothose skilled in the art. Such changes and modifications can be madewithout departing from the spirit and scope of the present subjectmatter and without diminishing its intended advantages. It is thereforeintended that such changes and modifications be covered by the appendedclaims.

REFERENCE SIGNS LIST

-   -   100, 200 information processing apparatus    -   101, 201 display    -   202 camera    -   111, 211 target-position setting part    -   112, 212 position-coordinate acquisition part    -   113, 213 direction acquisition part    -   114, 214 direction calculation part    -   115 haptic-feedback determining part    -   116 haptic-feedback presenting part    -   216 AR-processing part

The invention claimed is:
 1. An information processing apparatus, comprising: a position-coordinate acquisition part acquiring a position coordinate of the information processing apparatus; a target-position setting part setting a position coordinate of a target; a direction acquisition part acquiring an apparatus direction that the information processing apparatus faces; a direction calculation part calculating a target direction of the target with respect to the information processing apparatus based on the position coordinate of the target and the position coordinate of the information processing apparatus; and a haptic-feedback determining part determining a haptic feedback to be presented to a user on a basis of an angle between the apparatus direction and the target direction.
 2. The information processing apparatus according to claim 1, wherein the haptic-feedback determining part determines a first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is a predetermined value or more, and determines a second haptic feedback being different from the first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is less than the predetermined value.
 3. The information processing apparatus according to claim 2, wherein the haptic-feedback determining part determines an intensity of the first haptic feedback according to a size of the angle in the case that the angle is the predetermined value or more.
 4. The information processing apparatus according to claim 2, wherein the haptic-feedback determining part determines an intensity of the second haptic feedback according to a distance between the information processing apparatus and the target in the case that the angle is less than the predetermined value.
 5. The information processing apparatus according to claim 1, further comprising a haptic-feedback presenting part presenting the haptic feedback to the user, wherein the haptic-feedback presenting part produces an oscillation that causes the user to feel that the information processing apparatus is pulled in a predetermined direction.
 6. The information processing apparatus according to claim 1, wherein the target-position setting part setting the position coordinate of the information processing apparatus as the position coordinate of the target according to a predetermined operation input to the information processing apparatus.
 7. The information processing apparatus according to claim 1, wherein the position coordinate of the information processing apparatus is a position coordinate in a real space.
 8. The information processing apparatus according to claim 1, wherein the position coordinate of the target is a position coordinate in a map application.
 9. An information processing system, comprising: a position-coordinate acquisition part acquiring a position coordinate of the information processing apparatus; a target-position setting part setting a position coordinate of a target; a direction acquisition part acquiring an apparatus direction that the information processing apparatus faces; a direction calculation part calculating a target direction of the target with respect to the information processing apparatus based on the position coordinate of the target and the position coordinate of the information processing apparatus; and a haptic-feedback determining part determining a haptic feedback to be presented to a user on a basis of an angle between the apparatus direction and the target direction.
 10. The information processing apparatus according to claim 9, wherein the haptic-feedback determining part determines a first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is a predetermined value or more, and determines a second haptic feedback being different from the first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is less than the predetermined value.
 11. The information processing apparatus according to claim 10, wherein the haptic-feedback determining part determines an intensity of the first haptic feedback according to a size of the angle in the case that the angle is the predetermined value or more, and the haptic-feedback determining part determines an intensity of the second haptic feedback according to a distance between the information processing apparatus and the target in the case that the angle is less than the predetermined value.
 12. The information processing apparatus according to claim 9, further comprising a haptic-feedback presenting part presenting the haptic feedback to the user, wherein the haptic-feedback presenting part produces an oscillation that causes the user to feel that the information processing apparatus is pulled in a predetermined direction.
 13. An information processing method, comprising: acquiring a position coordinate of the information processing apparatus; setting a position coordinate of a target; acquiring an apparatus direction that the information processing apparatus faces; calculating a target direction of the target with respect to the information processing apparatus based on the position coordinate of the target and the position coordinate of the information processing apparatus; and determining a haptic feedback to be presented to a user on a basis of an angle between the apparatus direction and the target direction.
 14. The information processing method according to claim 13, wherein determining the haptic-feedback includes determining a first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is a predetermined value or more, and determining a second haptic feedback being different from the first haptic feedback as the haptic feedback to be presented to the user in a case that the angle is less than the predetermined value.
 15. The information processing method according to claim 14, further comprising determining an intensity of the first haptic feedback according to a size of the angle in the case that the angle is the predetermined value or more.
 16. The information processing method according to claim 14, further comprising determining an intensity of the second haptic feedback according to a distance between the information processing apparatus and the target in the case that the angle is less than the predetermined value.
 17. The information processing method according to claim 13, further comprising presenting the haptic feedback to the user with a haptic-feedback presenting part, wherein the haptic-feedback presenting part produces an oscillation that causes the user to feel that the information processing apparatus is pulled in a predetermined direction.
 18. The information processing method according to claim 13, wherein the position coordinate of the information processing apparatus as the position coordinate of the target is set according to a predetermined operation input to the information processing apparatus.
 19. The information processing method according to claim 13, wherein the position coordinate of the information processing apparatus is a position coordinate in a real space.
 20. The information processing method according to claim 13, wherein the position coordinate of the target is a position coordinate in a map application. 